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to section V. 

1 . The present invention relates to a method for routing messages from a source node 
to a destination node in a dynamic network, according to the features of claim 1 . 

2. The cited documents in the international search report are not considered to get 
closer to the subject-matter of claim 1 than the documents already acknowledged by 
the applicant. 

3. According to the features of claim 1 the inventive step consists in routing a 
predefined percentage of messages sent from the source node to a destination node 
by choosing the neighbour node with the highest probability value in the row for a 
destination node in the routing table, and routing the other messages by distributing 
the messages among the neighbour nodes according to the probability values given 
in the same row in the routing table. 

The underlying concept is not disclosed in or rendered obvious by the cited prior art 
documents. The subject-matter of claim 1 thus fulfils the requirements of Article 33 
PCT. 

4. The dependent claims 2 to 1 0 contain further details on the subject-matter of claim 1 . 
These dependent claims merely limit the scope of protection sought by claim 1 and 
are therefore also considered to fulfil the requirements of Article 33 PCT. 
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A METHOD FOR ROUTING MESSAGES PROM A SOURCE NODE TO A DES- 
TINATION NODE IN A DYNAMIC NETWORK 

Field of the invention 

The present invention applies to the problem of routing in 
ad-hoc networks (AHN) . Such networks may consist of mobile 
nodes, which communicate via wireless links. 



Background of the invention 



Communication in AHN may take place directly between two 
mobile nodes, if they are within an appropriate range of 
one another. More common is the case of multi-hop routing, 
in which nodes lying between the source node S and destina- 
tion node D serve as routers, conveying data from source to 
destination via multiple hops, it is technically challeng- 
ing to find such multi-hop paths, since the topology of the 
AHN is constantly changing due to the motion of the nodes 
Thus it is, in general, challenging to route messages be- 
tween nodes in an AHN. 

It should be noted that routing from a mobile node to a 
gateway node G (which is usually fixed in place) is also of 
significant interest. The gateway node then gives access 
from the mobile AHN to a fixed network. Node-gateway rout- 
ing can in principle include the multi-hop case, in which 
(again) intermediate mobile nodes serve as routers passing 
data to and from the gateway. 

The phrase «multi-hop routing in an ad-hoc network" can be 
used to apply to either of these two cases (mobile ~ mobile 
and mobile gateway) . 

The problem is to find good paths between pairs of nodes in 
an AHN that wish to communicate. There are various criteria 
for «good» paths. The path must be feasible (that is it 
must not be based on outdated topology information, which 
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uses links that no longer exist) . The path should also be 
as short as possible to minimize the use of bandwidth for 
relaying; and it should avoid congested areas which give 
rise to undesirable delay in the passing of data. 

Depending on the circumstances and the application, there 
can be other criteria for goodness of a path. The present 
invention is useful for any criteria of goodness, as long 
as these criteria can be measured in the course of the 
transmission of the data along the path. The criteria men- 
tioned above (existence, length, and delay of the path) are 
all measurable. 

Finding good paths is a readily soluble problem for a 
fixed, static network, when the network topology is time- 
dependent, entirely new problems arise. For a realistic and 
practical span of node mobility and wireless communications 
range, the network topology of an AHN can change more rap- 
idly than traditional methods, used for static networks, 
can follow. Hence new path- finding (routing) methods must 
be found for such dynamic networks. 

Routing in AHN has been studied intensively over the last 
10-15 years. The number of proposed routing protocols for 
an AHN is very large, and it is not practical to try to 
list them all here. 

Some overviews of ad-hoc routing protocols include the fol- 
lowing: 

S. Ramanathan and M. Steensrup, «a survey of routing tech- 
niques for mobile communications networks", Mobile networks 
and Applications, vol. l no. 2, p. 89, 1996. 

J. Broch, d.a. Maltz, d.b. Johnson, Y.-c. Hu, and j. 
Jetcheva, »a performance comparison of multi-hop wireless 
ad hoc network routing protocols", Proc. MobiCom '98, Dal- 
las, TX, USA, 1998. 
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E.M. Royer and C.-K. Toh, tt A review of current routing pro- 
tocols for ad hoc mobile wireless networks" , IEEE Personal 
Communications, April 1999 , p. 46. 

An electronic overview by Christian Tschudin of Uppsala 
University is at: 

http: //www. docs .uu. se/~tschudin/lect/2000200l/dn2/slides/ad 
hoc-4up.pdf . 

There is also a working group of the Internet Engineering 
Task Force (IETF) , which is dedicated to Mobile Ad-hoc Net- 
works or MANETs . See : 

http: / /www . ietf . ora/html . charters /manet -charter . html . 

Further, stochastic routing has been proposed for routing 
in fixed (but dynamic) networks in numerous research pa- 
pers. There is one research paper describing a specific 
stochastic routing scheme for ad-hoc networks: 

P. Gupta and P.R. Kumar, W A system and traffic dependent 
adaptive routing algorithm for ad hoc networks", Proceed- 
ings of the 36th IEEE Conference on Decision and Control, 
pp. 2375-2380, San Diego, Dec. 1997. 

Stochastic routing is a form of multipath routing. In mul- 
tipath routing, nodes maintain routing tables (RTs) with 
multiple choices of path for each possible destination. For 
dynamic networks it is advantageous to maintain multiple 
paths, as it allows for rapid change of path in case the 
first choice of path fails. Stochastic routing entails the 
maintenance of information about multiple paths, and also 
that the choice among multiple paths be made probabilisti- 
cally rather than deterministically . Thus stochastic rout- 
ing necessarily involves the following elements: each node 
S, viewed as a source of data, maintains an RT for every 
possible destination D. Each such RT has an entry for every 
neighbour k of S, with a probability p(k,D) . Thus, whenever 
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data are to be sent from S to D, neighbour k is chosen with 
probability p(k,D). 

Most ad-hoc routing protocols attempt to find a full path 
from a first node S to a second node D before sending data 
There are two broad categories for protocols doing this: 

Proactive protocols-. These protocols attempt to maintain a 
complete routing solution for the entire network at all 
times, in this sense, they are like those approaches used 
for routing on a static network - although they are of 
course adapted to better deal with the dynamic nature of 
the ahn. These protocols are also known as « table -driven" 
since they attempt to maintain information amounting to a 
complete set of routing tables for all s-D pairs. 

Reactive protocols: These protocols attempt to find paths 
from S to D only when the source S needs to send data to 
destination D. They are also known as "source -initiated" or 
"on-demand" protocols. A recent evaluation of two of the 
most prominent on-demand protocols is: 

CE. Perkins, E.M. Royer, s.R. Das, and M.K. Marina, "Per- 
formance comparison of two on-demand routing protocols for 
ad-hoc networks" , ieee Personal Communications, February 
2001, p. 16. * 

There are ad-hoc routing schemes that do not need to find a 
full path before sending data. Such schemes use one or both 
of the following mechanisms: 

Hierarchical protocols: the network is broken up into clus- 
ters. Routing within a cluster is done by any of the above- 
mentioned non-hierarchical methods. However, routing to a 
node outside S's cluster is done by sending the data to a 
designated gateway node. (Here the gateway is to another 
cluster, not to a fixed net; and the gateway nodes are also 
mobile nodes.) Data are then passed from cluster to cluster 



WO 2004/045166 




T/NO2003/000385 



5 



via the gateway nodes that must solve the intercluster 
routing problem until it reaches the cluster in which D 
lies. Then the data are routed to D using the intracluster 
protocol. Such hierarchical routing mimics that used for 
the static Internet. 

Location-aided protocols: If S knows its own geographic lo- 
cation, as well as that of D; it can send data in the di- 
rection of D without knowing a complete path to D. The 
challenge is then to maintain up-to-date information on the 
location of possible destination nodes, which are mobile. 
If the destination node is a fixed gateway node G (giving 
access to a fixed net) , then this challenge is trivial and 
one needs only to equip each mobile node with positioning 
technology . 

There is probably no unique best solution to the problem of 
multi-hop routing on an ad-hoc net. Such networks can vary 
widely in the mobility of the nodes, and in the pattern and 
volume of internode traffic. Each different type of routing 
scheme has its own weaknesses as described below. 

Proactive protocols : Such protocols obviously work best 
when the network topology is slowly varying. By the same 
token, when the network is too dynamic (e.g., because the 
nodes are too mobile) these protocols swamp the network 
with overhead messages, seeking to hold the full set of 
routing tables updated in the face of too much time varia- 
tion of the network. That is, these protocols fail when the 
network topology changes too often - typically because the 
node mobility is too high, and/or the network is too large. 
In short, the principle problem with proactive protocols is 
the large routing overhead incurred for dynamic networks. 

Reactive protocols: These protocols seek routes only when 
they are needed, thus reducing their routing overhead with 
respect to proactive protocols. That is, their routing 
overhead grows with network traffic rather than with net- 
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work transience. These schemes can thus work well for a 
highly dynamic network, as long as the traffic rate is not 
too high. For this reason they tend to be preferred over 
proactive protocols. 

Reactive protocols fail when the rate at which paths must 
be found exceeds the rate at which they can be found. This 
occurs due to high traffic (which increases the former 
rate) , high network transience (which increases the former 
rate and decreases the latter) , or large network size 
(which decreases the latter rate) . They are particularly 
vulnerable to the latter factor: if the network grows too 
large , then the time needed to find paths on demand can ex- 
ceed the time for which the path is valid-at which point 
routing becomes impossible. 

Of course, there is no AHN routing scheme which can handle 
an arbitrarily large network. However, the need to find an 
entire path in real time is a significant bottleneck for 
both of these classes of protocols— reactive and proactive. 

Hierarchical protocols: These schemes avoid the need to 
find an entire path before sending data. However, they face 
problems similar to those faced by proactive schemes — that 
is, they fail for networks that are too large and/or too 
dynamic. The reason is that they must repeatedly solve a 
network- wide problem: the choice of how to cluster the 
nodes into a hierarchy, and how to route between the clus- 
ters. For some mobility patterns (say, when nodes tend 
naturally to move in clusters) , the solutions to this 
global problem will not vary too rapidly. However, for the 
general AHN, with highly mobile nodes moving in an uncorre- 
cted fashion, a hierarchical scheme will incur unaccept- 
able overhead costs, particularly if the network is large. 

Location-aided protocols: These protocols largely avoid the 
overhead problems of the above-mentioned types, as they 
sinqply need to know the location of their destination in 
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order to send data. They then have two weaknesses. First, 
it can be difficult to obtain good enough information about 
the location of the destination. The source does not need 
exact knowledge of D's location, and so such schemes can 
work with partly-outdated information. Furthermore, regular 
communication with D serves to keep its location updated. 
Hence a problem arises only when nodes communicate in an 
irregular fashion (over time) with a number of different 
nodes, which are also far away geographically. 

A second problem with location-aided routing schemes is 
that they naturally rely on "aiming" the data towards D. 
That is, the next hop is chosen to be that neighbour clos- 
est to D. The problem arises when data arrive at a node 
that cannot reach D directly, and which also has no 
neighbour which is closer to D than it is itself. Such a 
node represents a "dead end" for this type of routing 
scheme, which thus must be augmented with some mechanism 
for routing around dead ends. Dead ends are most likely for 
AHNs with a low and/or very uneven density of nodes. 

Finally (as noted above) , note that routing to a fixed 
gateway node has only the second of these two problems 
since the location of the destination G is always known. 

Summary of the invention 

It is an object of the present invention to provide a 
method that eliminates the drawbacks described above. 

For this end, the present invention discloses a method for 
routing messages from a source node to a destination node 
in a dynamic network, said source node including a routing 
table, each row in the routing table representing a possi- 
ble destination node for a data message transmitted from 
the source node, and each row in the routing table includ- 
ing one probability value for each neighbour node of the 
source node, the method including to update the probability 
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values with quality measurements taken each time a message 
is sent from the source node to a destination node, 
routing a predefined percentage of the messages by choosing 
the neighbour node with the highest probability value in 
the row for a destination node in the routing table, 
and routing the other messages by distributing the messages 
among the neighbour nodes according to the probability val- 
ues given in the same row in the routing table. 

However, the exact scope of the invention is evident from 
the appended patent claims, which includes several pre- 
ferred embodiments. 

Detailed description 

As earlier mentioned, in general, it is challenging to 
route messages between nodes in an ahn. it is to this rout- 
ing problem the present invention is addressed, in particu- 
lar to multi-hop routing in an ad-hoc network. 

As earlier mentioned, stochastic routing has been proposed 
for routing in fixed (but dynamic) networks in numerous re- 
search papers; and a form of stochastic routing for AHN has 
been proposed in Gupta et al. 

The present invention employs stochastic routing for AHN. 
It involves the use of the data packets themselves as a 
means for updating the nodes' routing tables (RTs) , with a 
novel mixture of stochastic and deterministic routing for 
the data. The present invention also includes a novel 
method for updating rts in the event of the establishing of 
a new link. 

Every stochastic routing scheme needs a method for updating 
the RT probabilities (also called "weights"), m this pro- 
posed invention, each time a message is sent from S to D, 
it will measure the quality of the path taken. The quality 
measure may be number of hops, time delay, or other meas- 
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ures, or a combination of these. The method proposed here 
can be used for any such quality measure, as long as it is 
measurable. The quality measure for the path, along with 
the actual path taken, is then carried along with the data 
packet. This information represents a small amount of over- 
head included with the sending of data. 

RT updates are then performed as follows. If the links in 
the network are symmetrical, then the message can update 
RTs pointing towards S at each node N visited on the path 
since, by symmetry, the quality of the S— N path is the same 
as the quality of the N-S'path, so that the former can be 
used to update N's RT for destination S. 

If the links are not symmetrical, then the message arrives 
at D with information on the quality of the S— D path taken, 
plus a measure of the quality of all intermediate paths of 
the form S— N. This information is then sent back to S via a 
small, high-priority routing packet, and used to update the 
RTs at S for all nodes used in the path. Hence, this method 
requires that nodes have a mechanism for prioritizing pack- 
ets, so that these return routing packets can be given high 
priority. This in turn prevents the information they convey 
back to S from becoming obsolete. 

The measured quality of a path may be termed 5. Let 
p(k,D) (old) be the probability in the RT towards D via k 
before updating. Then the updated value is 



for the case that neighbour k was used in the path. The re- 
maining entries j for destination D are corrected to hold 
the probability sum to one: 



p(k 9 D)(new) 



p(k,D)(pld) + S 
l + S 



p(j\D)(new) 



P U\D)(old) 



l + S 
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This gives a general method for updating the weights in the 
RTs. The specific method for determining the update weight 
5 depends on the quality measure to be used. It can also be 
adjusted to force the network to adapt more quickly, or 
less quickly, in order to tune the performance of the 
method. These details are not specified in this invention, 
as this part of the updating procedure is not different 
from known methods for static networks. 

According to a preferred embodiment of the invention, every 
message is used as a source of updating information for the 
stochastic RTs. Hence, this method naturally adjusts the 
updating rate according to the traffic rate: at high traf- 
fic, RTs are frequently updated, and are hence likely to be 
reliable . 

There is another updating mechanism proposed in this inven- 
tion, which is independent of traffic rate, but instead is 
triggered by changes in network topology. This second 
mechanism thus keeps RTs updated even at low traffic rates, 
while playing a minor role at high traffic rates. 

The second updating mechanism is initiated by any node j 
when that node detects a change in its neighbour set NS(j) . 
The set of neighbours for a node using wireless links is 
something to be decided by an algorithm that adjusts power 
level in order to maintain connectivity, while attempting 
to hold interference among the various links as low as pos- 
sible. There is a number of such algorithms in use for 
AHNs. The present invention does not specify this algo- 
rithm. What is specified is a rule for responding to a 
change in the NS. Here there are two possible cases: (a) a 
neighbour is lost; and (b) a neighbour is gained. 

a) Loss of a neighbour: Suppose node j has lost its connec- 
tion to neighbour k. There are then two tasks to be per- 
formed: (i) the RTs for all destinations D must be ad- 
justed to reflect the removal of neighbour k. (ii) Node 
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j must build a set of weights (ie, a new row in its rt) 
specifying how to route to k, since k is no longer a 
one -hop neighbour. 

(i) For every destination D, the weights for the remain- 
ing NS of j must be adjusted so as to sum to one. It 
is proposed in this invention to adjust these weights 
in such a way that they retain the same relative 
weight that they had before the loss of neighbour k. 
This rule is motivated by the fact that loss of 
neighbour k has not provided any new information 
about the relative goodness of the remaining paths to 
D. 



(ii) Node j must wait a (tunable) time interval At(l) af- 
ter detecting loss of neighbour k. if connection to k 
has not been re-established after this time, and if 
node j has not attempted to send any data to k in 
that time, then node j shall emit a "dummy" message 
whose sole purpose is to provide needed routing in- 
formation between j and k. The RT of j towards k is 
initially set to equal weights, that is all 
neighbours of j are taken to be equally likely to 
provide a path to k. Hence, the dummy message emitted 
by j will choose outgoing neighbours of j with equal 
probability in its search for k. Subsequent nodes in 
the path will have routing information towards k; 
here the dummy message will choose the highest -weight 
path for its next hop along the way to k. For symmet- 
ric links, the dummy's quality measure can be used to 
update the RT (towards j) of each node visited along 
the way to k (including k itself) . For either symmet- 
ric or asymmetric links, upon reaching k, the dummy 
triggers a high-priority routing packet, which re- 
turns to j with a quality measure which can be used 
to update j'sRT towards k. if j has not received 
such a confirmation after a (tunable) time At (2) 
since the emission of the dummy, j will emit another 
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dummy. Thus, j will continue to emit dummies, seeking 
the lost neighbour k, until it succeeds. Note that 
with high probability for asymmetric links, and with 
100% probability for symmetric links, when j loses k 
as a neighbour, k also loses j, and so begins emit- 
ting dummies seeking j . The result of step (ii) is 
then that j and k have re-established up-to-date 
routing information connecting the two nodes. 

b) Gain of a new neighbour: Suppose j has gained a new 
neighbour w. Now there is only one task to be done, 
since the analogue of (ii) — finding the lost neighbour- 
ing node - is not needed here. The task is then to ad- 
just j's RT for all possible destinations D (other than 
w) , given that j has acquired a new neighbour. It is de- 
sirable to use the routing information stored in j's 
RTs, and also to use the routing information stored in 
w's RTs. This is done as follows. 

The object is to pool information from nodes j and w 
about how to reach destination D. The first step is to 
assess the quality of the information held by j and w, 
respectively. Quantitatively, j computes a routing- 
quality rating RQR(D, j ) for each destination D in its 
RT: 

RQR(D, J) = p(max, D) - /?(min, D) 

where p(max,D) is the largest weight in j's current list 
for destination D, and p(min,£>; is the smallest. Com- 
puted in this way, any RQR has a minimum value of zero 
(nothing is known about routing to D) , and a maximum of 
one (in which case only one, best route to D has any 
weight) . Node j also requests the RQR(D,w) for each des- 
tination D from node w. 

Now j will give more or less weight to the use of w as a 
route to D, according to the relative values of the two 



WO 2004/045166 ^ ^T/NO2003/000385 

13 

RQRs. If j had n neighbours before discovering W/ then 
it has n+l neighbours afterwards,- and so an average 
weight for node w would be 1/ (n+l) . Node j will deviate 
from this average value if the two RQRs (that of j, and 
that of w) are different enough, as follows. Let 

x = RQR(D,w) 
y = RQR(D,j) 

n + l { n + l) K 79 
Then the new weight given to node w in j's RT for d is 

p{w,D)(new)J fiX ' y) iff ^>° 
[ 0 otherwise 

This rule gives average weight to w if its RQR for D 
(which measures how much node w "knows" about routing to 
D) is the same as j's RQR for D. However, if w knows 
much more than j [RQR(D,w)=l, and RQR(D,j)=o], then w's 
new weight in j's routing table will be 100%. Finally, 
if w's RQR is sufficiently less than j's, it will get' 
zero weight, in short, this rule is designed to assess 
the relative "wisdom" of the two nodes, regarding the 
task of routing to D, and to weight paths to D from j 
via w accordingly. The remaining weight, that is, 1- 
p(w,D)(new). is divided proportionally among the 'remain- 
ing neighbours of j , with the proportions fixed to be 
the same as before the discovery of w. 

Given a routing table with multiple, weighted entries for 
each destination, there are three choices for how to route 
a packet towards that destination. These choices may be 
termed "uniform" or u routing, "regular- or r routing, and 
"greedy or g routing. 
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Uniform routing ignores the weights in the RT, and chooses 
the next hop with equal probability from the nodes in the 
neighbouring set. Uniform routing is not likely to be a 
good choice for routing data. However (as noted above), 
dummy messages seeking a lost neighbour node are routed (at 
the first hop) uniformly. Furthermore, it can be advanta- 
geous to emit small numbers of dummy messages even in the 
absence of changes in the NS. These messages serve as 
w noise" in the routing process. Their utility lies in that 
they can serve to discover good routes which would other- 
wise go unused, in the case that the system's RTs have set- 
tled on a different set of routes that were once the best, 
but are no longer so. That is, noise in routing prevents 
the "freezing" of the system into less-than-optimal routes. 
It is common in stochastic routing schemes to employ a 
small percentage f % of u-routed dummy messages; and in the 
proposed scheme such messages will also be used, with f a 
tunable parameter. 

Regular (r) routing sends data with the probabilities given 
in the RTs. This is stochastic routing. 

Finally, greedy (g) routing always chooses the highest- 
weight entry for the next hop. Hence, this routing method 
is deterministic. 

In studies of stochastic routing on fixed networks, it is 
common to use a significant number of dummy messages for 
the purpose of gathering routing information. These dummy 
messages are often called "agents" or "ants", the latter 
name coming from their nature as small objects swarming 
over the network, and leaving a "trail" behind them that 
guides other ants. In order for later ants to be able to 
profitably learn from earlier ants, it is important that 
the ants (dummy messages exploring the network) are routed 
with r routing. That is, they must follow the probabilities 
established by earlier experience. On the other hand, mes- 
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sages (in these studies) are typically routed using greedy 
routing: one chooses the best known path at any given time. 

Hence, previous studies of stochastic routing on fixed net- 
works have used r routing for dummy, exploratory messages 
(ants) , and g routing for data. In the proposed invention, 
ants and data are to be combined: every data packet trans- 
mitted through the network is used to update RTs, and there 
are few empty (dummy) messages used purely for exploring 
the network, in other words, messages also act as ants. 
Yet, since the two are combined, they must be routed by the 
same rule: g or r routing. 

In this invention, it is proposed to use a mixture of the 
two rules: h% of messages shall be routed with high prior- 
ity (greedy routing, highest weight) and (100-h)% of mes- 
sages shall be routed with standard priority (regular rout- 
ing, according to the weights in the RTs) . Ji is a tunable 
parameter. This invention employs a mixture of the two 
routing rules, in order to allow for the benefits of both: 
g routing will normally give the best performance for any 
given message; but r routing is needed to support the 
learning process that the messages, collectively, are con- 
tributing to. Hence, a mixture is chosen, with the propor- 
tion of each to be determined according to the performance 
achievable under a given set of operating conditions. 

Example 



Table 1 below shows an example of the routing table (RT) 
for a node, which we call the source S. 
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Destination 
1 

Destination 
2 

Destination 
3 

Destination 
4 



Neighbor 
1 



0.1 



0.45 



0.05 



0.2 



Neighbor 
2 



0.5 



0.05 



0.4 



0.2 



Neighbor 
3 



0.1 



0.2 



0.05 



0.2 



Neighbor 
4 



0.25 



0.1 



0.35 



0.2 



Neighbor 
5 



0.05 



0.2 



0.15 



0.2 



Table l 



in this example, the node S has five one-hop neighbors The 
RT then has a "goodness index" , which may be interpreted as 
a probability, for each neighbor and for each destination 
These indices help the node to decide which neighbor to 
use, for each destination. For example, if s wants to send 
to Destination l, Neighbor 2 is the best choice, according 
to the rt. 

Note (nb : this goodness index is not the route-quality rat- 
xng rqr.) Por example, the RQR for node s and Destination i 
is 0.5 - o.os = 0.45; while Destination 4 has the lowest 
RQR of 0. 

The «etc means that, in a typical ad-hoc network, there 
are more than 4 destinations. That is, the network, as 
seen from s, is composed of S itself (one node), plus S's 
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neighbors (here 5 more nodes) , plus all the rest, each of 
which may have a row in the RT. 

"Greedy routing" would always choose the neighbor with the 
highest goodness index. That is, given a destination D, 
scan the corresponding row of the RT, and pick the neighbor 
with highest index. 

Since the indices in each row sum to 1, they can be viewed 
as probabilities. "Regular routing" then says, given a des- 
tination D, scan the corresponding row of the RT, and 
choose the first-hop neighbor with a probability which is 
equal to the index for that neighbor in the row. That is, 
if S uses regular routing and wants to send to Destination 
1 # S needs an algorithm (this is standard) that chooses 
Neighbor 1 with probability 0.1, Neighbor 2 with probabil- 
ity 0.5, etc. 

When there are many possible choices of next hop for each 
destination, and a weight or probability for each one, then 
we say that the resulting routing scheme uses "stochastic 
routing" . 

Most (but not all) schemes using stochastic routing will 
use greedy routing for messages, and regular routing for 
"exploration packets" or "ants" . The former carry data, 
while the latter are used only to explore the net and 
gather information for use in updating the RTs . The inven- 
tive scheme asks data packets to take on both jobs. The 
prescription for how the data packets shall be routed is 
new: h% shall use greedy routing, and (l-h)% then use regu- 
lar routing. This way, one gets both good delivery and good 
exploration, while having low overhead by using very few 
pure -exploration packets. 

If the node S loses a neighbor, it will lose a whole column 
of the RT. Then node S must do two things: 
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(i) readjust the weights in the remaining columns of the 
existing rows, so that they again sum to 1. 

(ii) Add a new row to the table, since the lost node be- 
comes a new Destination. With no information about how to 
find this lost neighbor, node S fill the new row with equal 
weights (as illustrated for Destination 4 in the example 
RT) . However, the inventive method requires S to send out 
dummy messages looking for the lost neighbor. 

If node S discovers a new neighbour (there are standard 
procedures for this,- it is not a part of the present inven- 
tion) , a new column must be added (and, if the new neighbor 
was a Destination before, remove that row) . Adding a new 
column requires adjusting every row in the RT. Also, the 
new neighbor (call it NN) has just found a new neighbor, s. 
Hence both nodes must update all the rows of their RTs. The 
inventive method has a new and nice way of pooling informa- 
tion from both nodes, the new neighbor NN and S, so as to 
make the best use of their combined routing information, 
using RQRs. 

All of the new (and other) features of the present inven- 
tion described here can be used with hardwired networks, 
whenever such networks have sufficiently dynamic operating 
conditions, such as changing traffic patterns, or nodes or 
links changing their connectivity, so that adaptive schemes 
such as stochastic routing are beneficial. 

There is also an important case, termed "mesh networks", 
that is intermediate between the hardwired case and the ad- 
hoc network. Mesh networks use multi-hop routing among 
wireless nodes; but the nodes are not generally mobile in- 
stead they are fixed to buildings. Such networks can advan- 
tageously use algorithms similar to those used by ad-hoc 
networks. Such algorithms allow mesh networks to dispense 
with central control, even while allowing nodes (say, at 
individual homes) to enter and leave the network in an un- 
planned fashion. That is, mesh networks are most attractive 
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when they support a self-healing mechanism, very much like 
that used with ahn. The methods described in this invention 
could be profitably applied to mesh networks. Examples of 
companies now offering mesh-network technology include 
MeshNetworks, Skypiiot, CoWave, and Ember. 

It is most likely that ad-hoc routing will find its widest 
applicability when used in combination with fixed networks, 
isolated, mobile wireless networks are not likely to be of 
use except in special cases; but multi-hop and wireless 
connectivity promises to be a useful way to extend the 
reach and capacity of fixed networks with base stations . 
Thus, the likeliest use of AHNs will involve routing to and 
from a fixed gateway node, or base station. The present in- 
vention will be useful for this case, and will almost cer- 
tainly perform better for this case than for the "pure" 
case of only routing between mobile nodes within the AHN. 
This is because it is less challenging to route to a fixed 
gateway than to route to a large number of mobile destina- 
tions. Thus, fixed infrastructure, extended at the "edge" 
by multi-hop wireless routing, which in turn uses stochas- 
tic routing as described here, is a very promising scenario 
for future telecommunications systems. 

Location-aided routing also promises to perform well in 
such situations. In the event that it becomes practical to 
support the provision of real-time positioning information 
on low-cost, mobile, handheld devices, then such informa- 
tion should be combined with stochastic routing to give the 
simplest and most reliable support for multi-hop ad-hoc 
routing. More specifically, the present invention could be 
combined with location information to give even more effec- 
tive routing. 
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Patent 



claims 



1. A method for routing messages from a source node (S) 
to a destination node in a dynamic network, said source 
node including a routing table, each row in the routing ta- 
ble representing a possible destination node (d) for a data 
message transmitted from the source node (s) , and each row 
in the routing table including one probability value p(k,D) 
for each neighbour node (k) of the source node (s) , the 
method including to update the probability values with 
quality measurements taken each time a message is sent from 
the source node (S) to a destination node (D) , 
characterized in 

routing a predefined percentage of the messages by choosing 
the neighbour node with the highest probability value in 
the row for a destination node (D) in the routing table, 
and routing the other messages by distributing the messages 
among the neighbour nodes according to the probability val- 
ues given in the same row in the routing table. 

2. A method as claimed in claim 1, 

characterized in that the probability val- 
ues are updated according to the following expression: 

p(k,D)(pld)+S 

where S represent the measured quality of the link and 
piKDXold) represents the old probability value amount, and 
the remaining probability values in the routing table are 
adjusted in such a way that all the probability values in 
each row of the routing table sum to one. 



3. a method as claimed in claim 1 or 2, 

characterized in that the quality measures 
are represented by hops and/or time delays. 
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4. A method as claimed in claim 1, 

characterized in that at the detection of a 
lost connection with a neighbour node, for each row of the 
routing table forin the node, removing the probability 
value associated with the lost neighbour and adjusting the 
probability values of the rest of the neighbours so as to 
sum to one, and creating a new row in the routing table for 
the lost neighbour node, by initially assigning equal prob- 
ability values for each of the respective remaining 
neighbour nodes in the new routing table row, and then ad- 
justing the probability values according to quality meas- 
urements performed by data messages emitted from the node 
towards the lost neighbour node. 

5. A method as claimed in claim 4, 

characterized in that probability values 
are further adjusted to re-establish the relative relations 
among the remaining neighbours as prior to the loss of the 
neighbour node. 

6. A method as claimed in claim 4 or 5, 

characterized in awaiting a predefined pe- 
riod of time from the loss is detected until the adjustment 
of existing routing rowtables and creation of the new 
routing table rowis executed. 

7. A method as claimed in claim 6, 

characterized in that the messages per- 
forming the route quality measurements, and updating the 
routing tables, are simply the data messages themselves, 
dummy messages are specially emitted after the predefined 
time interval, and at regular intervals thereafter, only 
for the purpose of finding a lost neighbor node. 

8. A method as claimed in claim 1, 

characterized in at the detection of a gain 
of a new neighbour node (j), for both the new neighbour 
node (j) and the source node (S) , computing one route qual- 
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ity rating <RQR(D,j, and RQR(d,S)) for each possible desti- 
nation node (D) , based on the maximum probability value and 
minimum probability value for each destination node (D) , 
and 

for all possible destination nodes (D) , computing a new 
probability value for the new neighbour node based on the 
route quality rating for the neighbour node (j) and the 
source node (S) and the number of its associated neighbour 
nodes . 

9. A method as claimed in claim 8, 

characterized in that the route quality 
rating is equal maximum probability value minus minimum 
probability value. 

10. A method as claimed in claim 9, 

characterized in that the new probability 



value for the new neighbour node (j) is: 



0 otherwise 



where x is the quality rating of the new neighbour node, y 
is the quality rating of the node in question and n is the 
number of neighbour nodes before gaining the new neighbour 
node . 
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